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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

Claims 1-33 (canceled). 

Claim 34 (currently amended): An information retrieving system which retrieves 
information according to image data and moving image data, the information retrieving system 
comprising: 

a terminal unit having: 

image data obtaining means for obtaining image data and moving image data, and 
transmitting means for transmitting the image data and the moving image data obtained 
by the image data obtaining means to a communication network, and 
a server unit having: 

a first database in which retrievable recognizing image data is registered, 

a second database in which meta data corresponding to the recognizing image data 
registered in the first database is registered, 

an automatic extracting system that automatically detects and extracts information 
broadcast on television broadcasts, 

a registering section that collects the information broadcast on the television broadcasts 
and information published on web sites and registers the information as the retrievable 
recognizing image data to the first database, and collects meta data corresponding to the 
recognizing image data registered in the first database and registers the meta data to the second 
database, 

receiving means for receiving the image data and the moving image data transmitted 
from the terminal unit through the network, 

a feature extracting section which extracts a feature of image data of which the image 
data and the moving image data received by the receiving means are broken down frame by 
frame, 
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a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
data and the moving image data are broken down frame by frame with a feature of the 
recognizing image data, 

retrieving means for retrieving the recognizing image data having a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section, and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means, 

wherein the server unit allows the terminal unit to browse the meta data extracted by the 
meta data extracting means through the communication network. 

Claim 35 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the retrieving means calculates a score of the match rate to the recognizing 
image data according to the feature data of the image data transmitted from the terminal unit and 
retrieves the recognizing image data having the score which is a predetermined value or greater 
as image data having the high match rate, and 

wherein the retrieving means retrieves the recognizing image data included in individual 
pieces of the image data of which the image data and the moving image data are broken down 
frame by frame at a predetermined rate or greater as image data having the high match rate. 

Claim 36 (previously presented): The information retrieving 1 system as set forth in 
claim 35, 

wherein the server unit side obtains the feature data. 

i 

Claim 37 (previously presented): The information retrieving system as set forth in 
claim 35, 

wherein the terminal unit pre-obtains the feature data of each piece of the image data of 
which the image data and the moving image data obtained by the image data obtaining means are 
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broken down frame by frame and causes the transmitting means to transmit the feature data as 
the image data. 

Claim 38 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the retrieving means retrieves the recognizing image data according to data 
including either gray-scaled data of each piece of the image data of which the image data and the 
moving image data obtained by the image data obtaining means are broken down frame by frame 
or color information of each piece of the image data of which the image data and the moving 
image data obtained by the image data obtaining means are broken down frame by frame. 

» 

Claim 39 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the retrieving means outputs retrieved results corresponding to a plurality of 
image elements included in each piece of the image data of which the image data and the moving 
image data received by the receiving means are broken down frame by frame, and 

wherein the meta data is extracted from the second database accbrding to a retrieved 
result of a part of a plurality of image elements and other image elements of the plurality of 
image elements are retrieved from the first database according to the extracted meta data. 

Claim 40 (previously presented): The information retrieving system as set forth in 
claim 39, 

wherein the retrieving means has a first recognizing means for recognizing a person, a 
second recognizing means for recognizing characters, and a third recognizing means for 
recognizing a shape other than the person and the characters, and 

wherein the first, second, and third recognizing means perform recognizing processes for 
each piece of the image data of which the image data and the moving image data are broken 
down frame by frame and retrieve the person, the characters, and the shape other than the person 
and the characters included in individual pieces of the image data of which the image data and 
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the moving image data are broken down frame by frame as image elements from the recognizing 
image data. 

Claim 41 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the server unit transmits an address on the communication network for the meta 
data extracted by the meta data extracting means to the terminal unit and provides the meta data 
to the terminal unit on the communication network. 

) 

Claim 42 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the server unit transmits the meta data extracted by the meta data extracting 
means to the terminal unit through the communication network. 

Claim 43 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein when the meta data is browsed on the terminal unit, an address on the 
communication network relating to the meta data is allowed to be accessed from the terminal 
unit. ! 

Claim 44 (previously presented): The information retrieving system as set forth in 
claim 34, 

wherein the terminal unit is a portable telephone terminal having a camera function. 

Claim 45 (currently amended): An information retrieving method of a retrieving 
unit which retrieves information according to image data and moving image data which a 
terminal unit obtains, the information retrieving method comprising steps of: 

causing the terminal unit to obtain the image data and the moving image data; 

causing the terminal unit to transmit the image data and the moving image data obtained 
at the image data obtaining step from the tenninal unit to a communication network; 
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causing the retrieving unit to receive the image data and the moving image data 
transmitted at the transmitting step through the network; 

causing the retrieving unit to automatically detect and extract information broadcast on 
television broadcasts, 

causing the retrieving unit to collect the information broadcast on the television 
broadcasts and information published on web sites and register the information as retrievable 
recognizing image data to a first database, and collect meta data corresponding to the 
recognizing image data registered in the first database and register the meta data to a second 
database; 

causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which retrievable recognizing image data is registered according to a compared result 
of a feature of each piece of the image data of which the image data and the moving image data 
are broken down frame by frame with a feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 

wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 

Claim 46 (currently amended): An information retrieving unit which retrieves 
information according to image data, the information retrieving unit comprising: 

a first database in which retrievable recognizing image data is registered; 

a second database in which meta data corresponding to the recognizing image data 
registered to the first database is registered; 

an automatic extracting system that automatically detects and extracts information 
broadcast on television broadcasts. 
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a registering section that collects the information broadcast on the television broadcasts 
and information published on web sites and registers the information as the retrievable 
recognizing image data to the first database, and collects meta data corresponding to the 
recognizing image data registered in the first database and registers the meta data to the second 
database; 

receiving means for receiving image data and moving image data transmitted from a 
terminal unit through a communication network; 

a feature extracting section which extracts a feature of each piece of image data of which 
the image data and the moving image data received by the receiving means are broken down 
frame by frame; 

a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
data and the moving image data are broken down frame by frame with the feature of the 
recognizing image data; 

retrieving means for retrieving the recognizing image data having a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section; and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means, 

wherein the terminal unit is allowed to browse the meta data extracted by the meta data 
extracting means through the communication network. 

Claim 47 (currently amended): An information retrieving method of a retrieving 
unit which retrieves information according to image data, the information retrieving method 
comprising the steps of: 

causing the retrieving unit to automatically detect and extract infonnation broadcast on 
television broadcasts, 

causing the retrieving unit to collect the information broadcast on the television 
broadcasts and information published on web sites and register the information as retrievable 
recognizing image data to a first database, and collect meta data corresponding to the 
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recognizing image data registered in the first database and registers the meta data to a second 
database; 

causing the retrieving unit to receive image data and moving image data transmitted from 
a terminal unit through a communication network; 

causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which the retrievable recognizing image data is registered according to a compared 
result of the feature of the image data of which the image data and the moving image data are 
broken down frame by frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 

wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 

Claim 48 (currently amended): A non-transitory recording medium storing an 
information retrieving program which causes a computer unit to execute an information 
retrieving method of retrieving information according to image data, the information retrieving 
method comprising the steps of: 

causing the retrieving unit to automatically detect and extract information broadcast on 
television broadcasts, 

causing the retrieving unit to collect the information broadcast on the television 
broadcasts and information published on web sites and register the information as retrievable 
recognizing image data to a first database, and collect meta data corresponding to the 
recognizing image data registered in the first database and registers the meta data to a second 
database; 

causing the retrieving unit to receive image data and moving image data transmitted from 
a terminal unit through a communication network; 
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causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which the retrievable recognizing image data is registered according to a compared 
result of the feature of the image data of which the image data and the moving image data are 
broken down frame by frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 

wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 

Claim 49 (currently amended): An image recognizing unit which recognizes a 
predetermined shape from image data, comprising: 

a first database in which retrievable recognizing image data is registered; 

a second database in which meta data of the recognizing image data registered in the first 
database is registered; 

an automatic extracting system that automatically detects and extracts information 
broadcast on television broadcasts, 

a registering section that collects the information broadcast on the television broadcasts 
and information published on web sites and registers the information as the retrievable 
recognizing image data to the first database, and collects the meta data corresponding to the 
recognizing image data registered in the first database and registers the meta data to the second 
database; 

a feature extracting section which extracts a feature of image data of which input image 
data and input moving image data are broken down frame by frame; 

a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
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data and the moving image data are broken down frame by frame with the feature of the 
recognizing image data; 

retrieving means for retrieving the recognizing image data having a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section; and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means. 

Claim 50 (previously presented): The image recognizing unit as set forth in claim 49, 
wherein the retrieving means calculates a score of a match rate to the recognizing image 
data according to feature data of the input image data and retrieves the recognizing image data 
having the score which is a predetermined value or greater as the image data having the high 
match rate, and 

wherein the recognizing image data included in each piece of the image data of which the 
moving image data are broken down frame by frame at a predetermined rate or greater are the 
retrieved result corresponding to the moving image data. 

Claim 5 1 (previously presented): The image recognizing unit as set forth in claim 49, 
wherein the retrieving means retrieves the recognizing image data according to data 
including either gray-scaled data of each piece of the image data of which the input image data 
and the moving image data are broken down frame by frame or color information of each piece 
of the image data of which the input image data and the moving image data are broken down 
frame by frame. v 

Claim 52 (previously presented): The image recognizing unit as set forth in claim 49, 
wherein the retrieving means outputs retrieved results corresponding to a plurality of 

image elements included in individual pieces of the image data of which the image data and the 

moving image data are broken down frame by frame, and 

wherein the meta data is extracted from the second database according to a retrieved 

result corresponding to a part of the plurality of image elements and other image elements of the 
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plurality of image elements are retrieved from the first database according to the extracted meta 
data. 

Claim 53 (previously presented): The image recognizing unit as set forth in claim 52, 
wherein the retrieving means has a first recognizing means for recognizing a person, a 
second recognizing means for recognizing characters, and a third recognizing means for 
recognizing a shape other than the person and the characters, and 

wherein the first, second, and third recognizing means perform recognizing processes for 
each piece of the image data of which the image data and the moving image data are broken 
down frame by frame and retrieve the person, the characters, and the shape other than the person 
and the characters included in individual pieces of the image data of which the image data and 
the moving image data are broken down frame by frame as the image elements from the 
recognizing image data. 

Claim 54 (previously presented): The image recognizing unit as set forth in claim 52, 
wherein the meta data is extracted from the second database according to the retrieved 
result corresponding to the part of the plurality of image elements included in individual pieces 
of the image data of which the image data and the moving image data are broken down frame by 
frame and the other image elements of the plurality of image elements are retrieved from the first 
database according to the extracted meta data. 

Claim 55 (currently amended): An image recognizing method of recognizing a 
predetermined shape from image data, the image recognizing method comprising the steps of: 

causing a retrieving unit to automatically detect and extract information broadcast on 
television broadcasts, 

causing a- the retrieving unit to collect the information broadcast on the television 
broadcasts and information published on web sites and register the information as retrievable 
recognizing image data to a first database, and collect meta data corresponding to the 
recognizing image data registered in the first database and register the meta data to a second 
database; 
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causing the retrieving unit to extract a feature of image data of which input image data 
and input moving image data are broken down frame by frame, extract a feature of the 
recognizing image data registered in the first database, and retrieve the recognizing image data 
having a high match rate to an image element of the image data from the first database in which 
the retrievable recognizing image data is registered according to a compared result of the feature 
of the image data of which the image data and the moving image data are broken down frame by 
frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data of the recognizing image data registered in the first database is registered according to 
a retrieved result at the retrieving step. 

Claim 56 (currently amended): A non-transitory recording medium storing an 
image recognizing program which causes a computer unit to execute an image recognizing 
method of recognizing a predetermined shape from image data, the image recognizing method 
comprising the steps of: 

causing a retrieving unit to automatically detect and extract information broadcast on 
television broadcasts, 

causing a— the retrieving unit to collect the information broadcast on the television 
broadcasts and information published on web sites and register the information as retrievable 
recognizing image data to a first database, and collect meta data corresponding to the 
recognizing image data registered in the first database and register the meta data to a second 
database; 

causing the retrieving unit to extract a feature of image data of which input image data 
and input moving image data are broken down frame by frame, extract a feature of the 
recognizing image data registered in the first database, and retrieve the recognizing image data 
having a high match rate to an image element of the image data from the first database in which 
the retrievable recognizing image data is registered according to a compared result of the feature 
of the image data of which the image data and the moving image data are broken down frame by 
frame with the feature of the recognizing image data; and 
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causing the retrieving unit to extract the meta data from the second database in which the 
meta data of the recognizing image data registered in the first database is registered according to 
a retrieved result at the retrieving step. 

Claim 57 (new): The information retrieving system as set forth in claim 34, wherein 
the automatic extracting system automatically detects and extracts commercials from the 
television broadcasts. 

Claim 58 (new): The information retrieving system as set forth in claim 34, wherein 
the registering section collects the meta data from a different source than where the 
corresponding recognizing image data is collected. 

Claim 59 (new): The information retrieving system as set forth in claim 34, wherein 
the feature comparing section calculates a positional relationship of a plurality of feature points. 
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